A High permormance hardware architecture for an sad reuse based hierarchical motion estimation algorithm for H.264 video coding

In this paper, we present a high performance and low cost hardware architecture for real-time implementation of an SAD reuse based hierarchical motion estimation algorithm for H.264 / MPEG4 Part 10 video coding. This hardware is designed to be used as part of a complete H.264 video coding system for portable applications. The proposed architecture is implemented in Verilog HDL. The Verilog RTL code is verified to work at 68 MHz in a Xilinx Virtex II FPGA. The FPGA implementation can process 27 VGA frames (640x480) or 82 CIF frames (352x288) per second

HSTR-Net: Reference Based Video Super-resolution for Aerial Surveillance with Dual Cameras

Aerial surveillance requires high spatio-temporal resolution (HSTR) video for more accurate detection and tracking of objects. This is especially true for wide-area surveillance (WAS), where the surveyed region is large and the objects of interest are small. This paper proposes a dual camera system for the generation of HSTR video using reference-based super-resolution (RefSR). One camera captures high spatial resolution low frame rate (HSLF) video while the other captures low spatial resolution high frame rate (LSHF) video simultaneously for the same scene. A novel deep learning architecture is proposed to fuse HSLF and LSHF video feeds and synthesize HSTR video frames at the output. The proposed model combines optical flow estimation and (channel-wise and spatial) attention mechanisms to capture the fine motion and intricate dependencies between frames of the two video feeds. Simulations show that the proposed model provides significant improvement over existing reference-based SR techniques in terms of PSNR and SSIM metrics. The method also exhibits sufficient frames per second (FPS) for WAS when deployed on a power-constrained drone equipped with dual cameras.Comment: 15 pages, 8 figures, 8 table

Cytokine Gene Polymorphisms across Tuberculosis Clinical Spectrum in Pakistani Patients

BACKGROUND: Pakistan ranks 7(th) globally in terms of tuberculosis (TB) disease burden (incidence 181/100000 pop./yr; prevalence of 329/pop./yr). Reports from different populations show variable associations of TB susceptibility and severity with cytokine gene polymorphisms. Tuberculosis clinical severity is multi-factorial and cytokines play a pivotal role in the modulation of disease severity. We have recently reported that the ratio of two key cytokines (IFNgamma and IL10) show significant correlation with the severity spectrum of tuberculosis. The objective of the current study was to analyze the frequency of cytokine gene polymorphisms linked to high and low responder phenotypes (IFNgamma +874 T(hi)-->A(lo) and IL10 -1082 G(lo)-->A(hi)) in tuberculosis patients. METHODS AND FINDINGS: STUDY GROUPS WERE STRATIFIED ACCORDING TO DISEASE SITE AS WELL AS DISEASE SEVERITY: Pulmonary N = 111 (Minimal, PMN = 19; Moderate, PMD = 63; Advance, PAD = 29); Extra-pulmonary N = 67 (Disseminated DTB = 20, Localized LTB = 47) and compared with healthy controls (TBNA = 188). Genotype analyses were carried out using amplification refractory mutation system-PCR (ARMS-PCR) and stimulated whole blood (WB) culture assay was used for assessing cytokine profiles. Our results suggest that the IFNgamma +874 TT genotype and T allele was overrepresented in PMN (p = 0.01) and PMD (p = 0.02). IFNgamma +874 TT in combination with IL10 GG(lo) genotypes showed the highest association (chi(2) = 6.66, OR = 6.06, 95% CI = 1.31-28.07, p = 0.01). IFNgamma AA(lo) on the other hand in combination with IL10 GG(lo) increased the risk of PAD (OR = 5.26; p = 0.005) and DTB (OR = 3.59; p = 0.045). CONCLUSION: These findings are consistent with the role of IL10 in reducing collateral tissue damage and the protective role of IFNgamma in limiting disease in the lung

Familial hypercholesterolaemia in children and adolescents from 48 countries: a cross-sectional study

Background: Approximately 450 000 children are born with familial hypercholesterolaemia worldwide every year, yet only 2·1% of adults with familial hypercholesterolaemia were diagnosed before age 18 years via current diagnostic approaches, which are derived from observations in adults. We aimed to characterise children and adolescents with heterozygous familial hypercholesterolaemia (HeFH) and understand current approaches to the identification and management of familial hypercholesterolaemia to inform future public health strategies. Methods: For this cross-sectional study, we assessed children and adolescents younger than 18 years with a clinical or genetic diagnosis of HeFH at the time of entry into the Familial Hypercholesterolaemia Studies Collaboration (FHSC) registry between Oct 1, 2015, and Jan 31, 2021. Data in the registry were collected from 55 regional or national registries in 48 countries. Diagnoses relying on self-reported history of familial hypercholesterolaemia and suspected secondary hypercholesterolaemia were excluded from the registry; people with untreated LDL cholesterol (LDL-C) of at least 13·0 mmol/L were excluded from this study. Data were assessed overall and by WHO region, World Bank country income status, age, diagnostic criteria, and index-case status. The main outcome of this study was to assess current identification and management of children and adolescents with familial hypercholesterolaemia. Findings: Of 63 093 individuals in the FHSC registry, 11 848 (18·8%) were children or adolescents younger than 18 years with HeFH and were included in this study; 5756 (50·2%) of 11 476 included individuals were female and 5720 (49·8%) were male. Sex data were missing for 372 (3·1%) of 11 848 individuals. Median age at registry entry was 9·6 years (IQR 5·8-13·2). 10 099 (89·9%) of 11 235 included individuals had a final genetically confirmed diagnosis of familial hypercholesterolaemia and 1136 (10·1%) had a clinical diagnosis. Genetically confirmed diagnosis data or clinical diagnosis data were missing for 613 (5·2%) of 11 848 individuals. Genetic diagnosis was more common in children and adolescents from high-income countries (9427 [92·4%] of 10 202) than in children and adolescents from non-high-income countries (199 [48·0%] of 415). 3414 (31·6%) of 10 804 children or adolescents were index cases. Familial-hypercholesterolaemia-related physical signs, cardiovascular risk factors, and cardiovascular disease were uncommon, but were more common in non-high-income countries. 7557 (72·4%) of 10 428 included children or adolescents were not taking lipid-lowering medication (LLM) and had a median LDL-C of 5·00 mmol/L (IQR 4·05-6·08). Compared with genetic diagnosis, the use of unadapted clinical criteria intended for use in adults and reliant on more extreme phenotypes could result in 50-75% of children and adolescents with familial hypercholesterolaemia not being identified. Interpretation: Clinical characteristics observed in adults with familial hypercholesterolaemia are uncommon in children and adolescents with familial hypercholesterolaemia, hence detection in this age group relies on measurement of LDL-C and genetic confirmation. Where genetic testing is unavailable, increased availability and use of LDL-C measurements in the first few years of life could help reduce the current gap between prevalence and detection, enabling increased use of combination LLM to reach recommended LDL-C targets early in life

Super-resolution based coding approach for H.264 standard

21st Signal Processing and Communications Applications Conference (SIU) -- APR 24-26, 2013 -- CYPRUSWOS: 000325005300016In literature video coding efficiency of H. 264 standard has been improved using decoder-side super-resolution (SR). In this paper SR estimation is used during encoding in place of skip/direct mode prediction of H. 264 standard and coding performance is optimized. First P-and B-frames are downsampled and H. 264 encoded at lower resolution (LR). Then reconstructed LR frames are super-resolved using decoder-side motion estimation. Also bicubic interpolation of the LR frame is used as an alternative to SR reconstruction. A rate-distortion optimal mode selection algorithm determines for each macroblock which of the two reconstructions to use as skip/direct mode prediction. Simulations indicate an average of 1.36 dB PSNR improvement or 30.3% bitrate reduction at low bitrates when compared to H. 264 standard. Average PSNR gains reach as high as 3.63 dB depending on the video content

Scene Labeling using Kernel Codebook Encoding

25th Signal Processing and Communications Applications Conference (SIU) -- MAY 15-18, 2017 -- Antalya, TURKEYWOS: 000413813100213Superpixel based methods have recently shown success in scene segmentation and labeling. In scene labeling, a superpixel algorithm is used first to segment the image into visually consistent small regions; then several feature descriptors are computed and classification is performed for each superpixel. In this paper, Kernel Codebook Encoding (KCB) of superpixel features is proposed. In KCB feature vectors are mapped to multiple codewords in a soft manner, instead of the usual hard quantization. The weights assigned to the codewords are determined by a kernel distance function. KCB method is used for encoding of SIFT features in SuperParsing image parsing algorithm. The developed approach is tested on the SIFT Flow dataset consisting of 2,688 images and 33 classes, and achieves 2.7% increase in parsing accuracy over SuperParsing.Turk Telekom, Arcelik A S, Aselsan, ARGENIT, HAVELSAN, NETAS, Adresgezgini, IEEE Turkey Sect, AVCR Informat Technologies, Cisco, i2i Syst, Integrated Syst & Syst Design, ENOVAS, FiGES Engn, MS Spektral, Istanbul Teknik Uni

Occlusion Artifact Removal in Video Frame Rate Up-conversion

IEEE 17th Signal Processing and Communications Applications Conference -- APR 09-11, 2009 -- Antalya, TURKEYWOS: 000273935600131In the past, frame rate up-conversion (FRC) methods were commonly used in standards conversion. Today, FRC methods are used for digital video temporal resolution enhancement to improve the visual quality in large screen LCD and plasma TV sets. The increase in processing power of DSPs, FPGAs and ASICs enables high complexity algorithms in the design of FRC systems. In this paper, we propose a multi-stage motion vector (MV) post-processing algorithm with occlusion adaptive overlapped block motion compensation, which increases the temporal resolution without loss of spatial resolution and consistency. Hexagonal search block matching yields us unreliable MVs which are post-processed in the refinement stages in order to get a consistent MV field in spatial domain. Relations between neighboring MVs and the MV fields of 4 consecutive frames are utilized to detect occlusion regions. Overlapped Block Motion Compensation (OBMC) is adapted to these problematic regions in order to reduce artifacts due to occlusion. Compared to existing methods, the developed algorithm achieves FRC with reduced loss of spatial resolution and reduced amount of artifacts.IEE